An extensive library of symptom inventories has been developed over time to measure clinical symptoms, but this variety has led to several long standing issues. Most notably, results drawn from different settings and studies are not comparable, which limits reproducibility. Here, we present an artificial intelligence (AI) approach using semantic textual similarity (STS) to link symptoms and scores across previously incongruous symptom inventories. We tested the ability of four pre-trained STS models to screen thousands of symptom description pairs for related content - a challenging task typically requiring expert panels. Models were tasked to predict symptom severity across four different inventories for 6,607 participants drawn from 16 international data sources. The STS approach achieved 74.8% accuracy across five tasks, outperforming other models tested. This work suggests that incorporating contextual, semantic information can assist expert decision-making processes, yielding gains for both general and disease-specific clinical assessment.

We investigate how disagreement in natural language inference (NLI) annotation arises. We developed a taxonomy of disagreement sources with 10 categories spanning 3 high-level classes. We found that some disagreements are due to uncertainty in the sentence meaning, others to annotator biases and task artifacts, leading to different interpretations of the label distribution. We explore two modeling approaches for detecting items with potential disagreement: a 4-way classification with a "Complicated" label in addition to the three standard NLI labels, and a multilabel classification approach. We found that the multilabel classification is more expressive and gives better recall of the possible interpretations in the data.

The pizzeria vowed on Monday to stay open despite a shooting incident sparked by a fake news report that it was fronting a child sex ring run by Democratic presidential candidate Hillary Clinton. On Sunday afternoon, a 28-year-old man walked into a Washington, D.C. ping-pong bar and pizzeria. He was carrying an AR-15 assault rifle – hardly standard-issue hardware for a round of table tennis. He fired one or more shots, as people fled Comet Ping Pong, before surrendering to police officers. Edgar Maddison Welch told police he had traveled from his home in Salisbury, N.C. to the nation's capital to investigate a pre-election conspiracy theory, wherein Democratic presidential nominee Hillary Clinton allegedly led a child-trafficking ring out of Comet Ping Pong.